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Abstract 

We propose novel parameter estimation algorithms for a class of dynamical systems with nonlinear 
parametrization. The class is initially restricted to smooth monotonic functions with respect to a linear 
functional of the parameters. We show that under this restriction standard persistent excitation suffices 
to ensure exponentially fast convergence of the estimates to the actual values of unknown parameters. 
Subsequently, our approach is extended to cases in which the monotonicity assumption holds only locally. 
We show that excitation with high-frequency of oscillations is sufficient to ensure convergence. Two 
practically relevant examples are given in order to illustrate the effectiveness of the approach. 
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1 Introduction 



Broad areas of applied and fundamental science require parameter identification of nonlinear systems. Re- 
search of these systems has made substantial progress in identification of both static and dynamic linearly 
parameterized systems ^7],^J, as well as static nonlinear ones |S] , J3] , (221 > EI ■ Parameter estimation of 
dynamic systems with nonlinear parametrization, however, has long remained an open issue. One possible 
way, in principle, to address this problem is to try to derive the estimator for the general nonlinear case. 
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In this hard problem a breakthrough has resulted in an advanced method jT". This method applies to a 
large class of nonlinear systems. Despite this major advancement the price for such generality are several 
theoretical and practical limitations. First, it is required that uncertainty be Lipshitz in time. Second, extra 
control is needed in order to dominate the nonlinearity during identification. The third and most important 
restriction is the necessity to satisfy the nonlinear persistent excitation condition, which computationally is 
more difficult to check than conventional persistent excitation assumptions |18| . |19p and often is not easy 
to satisfy if state-dependent nonlinearities are allowed. 

An alternative strategy would be to consider a class of nonlinear parameterizations that is narrower, but 
still sufficiently broad to be practically relevant. Currently there are a number of models, for instance Ham- 
merstain (Wiener) models [201 1 IS] i El i El i with specific restrictions on the nonlinearity in the parameters 
that allow to avoid the problems arising in the general parametrization case. These models, however, handle 
only static input (output) nonlinearities. Local linear (nonlinear) model techniques jl5| . |28| . jlOj constitute 
another promising tool. These models, on the other hand, are not always physically plausible. In practice in 
order to identify parameters of actual physical processes in a system, it is often necessary with these models 
to refit the data to the original nonlinearly parameterized model. 

In this article we address the problem of parameter estimation of dynamic nonlinear parameterized sys- 
tems in a way that compromises between the pros and cons of both strategies mentioned above. In particular, 
we allow nonlinear state-dependent parametrization in the model, while restricting the nonlinearities in pa- 
rameters to be of a certain practically relevant class. As a result we obtain parameter estimation procedures 
that are not limited to Lipshitz nonlinearities in time. These procedures neither require domination of the 
nonlinearity, nor do they rely on nonlinear persistent excitation conditions. On the other hand, the class of 
nonlinear parameterizations that we propose is wide enough to include a variety of models in physics, me- 
chanics, physiology and neural computation pp, Qli jHl- For this new class of parameterizations we show 
that conventional persistent excitation conditions guarantee exponential convergence of the estimates to the 
actual values of the parameters. Moreover, in case our assumptions are satisfied only locally, sufficiently 
high frequency of excitation still ensures convergence. 

The paper is organized as follows. In Section 2 we formulate the problem, Section 3 contains the main 
results of the paper, in Section 3 we provide two practically relevant illustrative applications of our method, 
and Section 4 concludes the paper. 

^See also 1221 . 1311 . where relaxed formulations of persistent excitation conditions are discussed. 
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2 Problem Formulation 



Let the following system be given: 

xi = fi(x) + gi(x)w, 

X2 = f2(x,0)+g2(x)M, (1) 

where 

XI {xii,...,xim,f eR"'' 

X2 = {x21,...,X2m,f 
X = {Xii , . . . , Xirm , X21 , . . . , X2m2 )^ ^ 

6 E rte ^ M."^ is a vector of unknown parameters, u is the control input, and functions fi : M" M™"^, 
f2 : R" xW^ M™^gl : M" ^ M^i, g2 : M" ^ M"'^ are locally bounded^. Vector x e M" is a state 
vector, and vectors xi, X2 are referred to as uncertainty independent and uncertainty dependent partitions of 
x respectively. We assume that ftg is bounded, and therefore without loss of generality it is safe to assume 
that fig is a closed ball or hypercube in R''. 

For the sake of compactness we introduce the following alternative description for : 

x = f(x,0) + g(xK (2) 

where 

SW = (3ll(x), . . . ,31,^1 (x),5r2l(x), . . . ,5r2m2(x))'^ 

f(x) = (/n(x), . . . , /i™,(x), /2i(x, 0), . . . , /2™,(x, e)f 

Our goal is to derive both the control function ii(x, t) and estimator 6{t) such that all trajectories of 
the system are bounded and the estimate 6{t) converges to unknown 6 £ fig asymptotically. In addition, 
in order to ensure boundedness of the trajectories we will restrict all possible motions of system ^ to an 
admissible domain in the system state space. As a measure of closeness of the trajectories to the desired 
solution we introduce the smooth error function t/' : R" x R R, ip eC^. The function is bounded 

in t for every bounded x. The target manifold, therefore, is given by 

V'(x,i) =0 

Consider the transverse dynamics of system ^ with respect to V'lx, t): 

^ = -^f (x,e)f/'(x, t) + Lg(x)V'(x, t)u + , (3) 

^Function f(x) : M" — » R™- is said to be locally bounded if for any ||x|| < S there exists constant D{S) > such that the 
following holds: ||f(x)|| < D{S). 
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where if(x,e) is Lie derivative of function tp{x,t) with respect to vector field f(x,0). Let us further assume 
that L^(^.^^ijj(x,t) is separated from zero (i.e. there exists positive S > such that |Lg(-x)V'(x, i)| > S for any 
X e R"; t G This assumption automatically implies existence of the inverse Lg(x)'0(x, t)^^. Hence, we 

can select control input u from the following class of functions: 

^.(x, e, t) = (Lg(x)VXx, i))-^ (-Lf (x,e)'/'(x, t) - ^i^P) - ^^^), (4) 

where 

ifi -.R^R, ip{iP) €C\ ip{^)ip > ip ^0, lim / ^(^df = oo. (5) 

Jo 

Denoting Lf(^.^ g^ijj(x, t) = /(x, 0, t) and taking into account Q we can rewrite equation ^ in the following 
manner: 

V' = /(x,0,t)-/(x,0,i)-(^(V^) (6) 

It is natural to require that boundedness of 'ilj{'x.,t) implies boundedness of the state insofar as ip{'K.,t) 
stands for the deviation from target manifold V'(x, t) = 0. Let us formally introduce this requirement in the 
following assumption: 

Assumption 1 For the given function ip{yi,t) the following holds: 

■(/'(x, t) e Loo ^ X G Loo 

Assumption ^ can be considered a bounded input - bounded state assumption for system along the 
constraint '!/'(x, t) — v{t), where functions u is chosen to satisfy this requirement and signal v(t) serves as 
input. If, however, boundedness of the state is not required or is achieved by extra control, Assumption ^ 
can be removed from the statements of our results or replaced, when necessary, with the requirement for the 
function f{x,6, t) to be globally bounded in x and locally bounded in 9. 

So far the only deviation from standard descriptions of the problem resides in the specification of function 
/(x, 0, t). Since a general parametrization of function /(x, 0, t) is methodologically difficult to deal with but 
solutions provided for the restricted classes of nonlinearities often yield physically implausible models, we 
have opted to search for a new class of practically reasonable parameterizations. Such a class should be able 
to include a sufficiently broad range of physical models, in particular those with nonlinear parametrization; 
they should also, in principle, be able to handle arbitrary (in the class of smooth functions) nonlinearity in 
states. As a candidate for such a parametrization we suggest nonlinear functions that satisfy the following 
assumption: 

Assumption 2 (Monotonicity and Linear Growth Rate in Parameters) There exists function a{x,t) : 
M" X M ^ M'* and D>0 such that 

(/(x, 9, t) - /(x, e, t))(a(x, tf{9 - 0)) > V /(x, 0, t) ^ /(x, 9, t) 
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\f{x,e,t) - f{x,e,t)\ < D\cx{^,tf{e - e)\, d>o 

The first statement in Assumption [21 holds, for example, for every smooth nonlinear function which is 
monotonic with respect to a linear functional over a vector of parameters 6: /(x, (/)(x)"^0, <). The second 
inequality is satisfied if the function f {x, <p{x.)'^ 9 , t) does not grow faster than a linear function in variable 
(f>{x)'^9 for every x e M". This set of conditions naturally extends systems that are linear in parameters to 
those with nonlinear parametrization. In addition to linearly parameterized systems, Assumption |21 covers 
a considerable large variety of practically relevant models with nonlinear parametrization. These include 
effects of stiction forces 0, slip and surface dependent friction given by the "magic formula" smooth 
saturation, and dead-zones in mechanical systems. The set of functions covered by Assumption [21 further 
includes nonlinearities in models of bio- reactors 0]. The class of functions /(x, 6, t) specified in Assumption 
[21 can also serve as nonlinear replacement of the functions that are linear in their parameters in a variety of 
piecewise approximation models. Last but not least it includes sigmoid and Gaussian nonlinearities, which 
are favored in neuro and fuzzy control and mathematical models of neural processes [S]. 

In this article we attempt to resolve the following main issue: how to design the estimator 0(x, t) which 
ensures convergence of the estimates to the actual values of a-priori unknown parameter 6, and what further 
restrictions (if any) on functions f{ji,6,t) are to be satisfied in order to guarantee such convergence? 

3 Main Results 

Let us introduce the following adaptation algorithm 

0(x,t) = r(0p(x,i)+0/(t)); 
0p(x,t) = ■0(x,t)a(x,t) - *(x,t) 

9i = (^(V'(x,t))a(x,t)+a*(x,t)/at-V'(x,i)(9a(x,t)/at)- 

(-0(x, t)ifiQ:(x, - LfjVl/(x, t)) - (?/;(x, t)igjQ:(x, ^) - Lg^^i{x,t))u(x,6,t) 

+/3(x, t)(f2(x, 9) + g2(x)7.(x, 9, t)), (7) 

where functions ^'(x, t), /3(x, t) satisfy the following condition with respect to the vector-fields of system 
and function a(x, i): 

Assumption 3 There exists function 4'(x, i) such that 

^---^ix,t)^—^P{x,t) 
where /3(x, t) is ether zero or, i/f2(x, 0) is dijferentiable in 9, satisfies the following: 

/3(x, i)Jf(x, 9, 9') > V0, 9' ene, x G M" 



^Parameter adjustment algorithms J7J can be considered as generalizations of the algorithms introduced earlier by the 
authors in I2bl . l25l . In these works we analyzed stabilizing properties of these algorithms in connection with realizability issues. 
Parameter convergence and identifying properties of algorithms were not addressed there. 
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^(x,0,0')= /'^^^^^^^rfA, s{X) = 9'X + 9{l-X) 
Jo OS 

Assumption 13 can be viewed as a kind of a structural restriction. Indeed, one can easily see that it auto- 
matically holds for the cases where = 0, i.e. when function a{x,t) does not depend explicitly on 
vector X2 , which stands for the uncertainty-dependent partition of system Q . Assumption |21 holds also 
for one-dimensional uncertainty-dependent partitions if function ^{x, t) ^"^^'*) jg Riemann-integrable with 
respect to X2 (vector X2 is one-dimcnsional in this case, /?(x, t) =0). Although it may seem to be difficult to 
find functions ^'(x, t) satisfying requirements of Assumption |31 in general the difficulty of the problem can 
significantly be reduced by embedding the system dynamics into one of a higher order, for which Assumption 
Olis satisfied a-priori. Sufficient conditions ensuring existence of such embedding for the parameterizations 
of general structure are provided in ^26; . For systems where parametric uncertainty can be reduced to vector 
fields with low-triangular structure the embedding is given in |27) . An alternative and the easiest way to 
construct this embedding is to design a system of which the output X2(i) tracks vector X2 with the pre- 
scribed level of performance by use of high-gain robust observers. The former is then used in the adjustment 
algorithm as replacement for the latter. This makes it possible to reduce the problem either to one of al- 
ready considered cases of independence of q;(x, t) on uncertainty-dependent partitions or to single-dimension 
partitions of X2 . This technique is illustrated in detail in the examples section. 

Properties of system ^ with control and adaptation algorithm Q are summarized in Theorem ^ 
and Theorem 12 

Theorem 1 (Stability and Convergence) Let system Qj, ^ be given and Assumptions\^^hold. 

Then 

PI) ifiim) G m e 

P2) ||0 — 0(t)||p_i is non-increasing; 
PS) /((x,0,i)-/(x,0(i),t)) £^2. 
Furthermore, 

Mi,)\\l < 2Q(^) + ||0(o)-0||22^P)_,, u\\l<2QW + \\eio)-e\\l^^y, 

Moo < A{QW + \\m-e\\f,^r)-^), (8) 

where Q{'4') = ^{^)d^ and A(rf) = max|,;,|{|V| | /J'^' ^i<^)d<; = d}. 

If Assumption^ is satisfied and function f{x,6,t) is locally bounded with respect to x, 9 and uniformly 
bounded with respect to t, then 

P4) trajectories of the system are bounded and ^j(x{t)) ^ as t — > 00; 

// in addition functions ip, f('K,0,t) € , derivative df{'x.,6,t)/dt is uniformly bounded in t, function 
Q;(x, t) is locally bounded with respect to x and uniformly bounded with respect to t, then 
P5) i>^0 ast^ 00; /((x, e, t) - /(x, e{t),t)) -^0 as t-^ 00. 
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Proofs of Theorem n and subsequent results are given in the Appendix. 

Theorem Q] ensures for algorithms iQ asymptotic reaching of the control goal and boundedness of the 
solutions of the closed-loop system. In addition, it provides improved transient performance, which can be 
characterized by a-priori computable L2 norms for and ip. In the case where f{'x.,6,t) ^ f{:x.^6,t) along 
the system solutions it further guarantees reduction of parametric uncertainties (property P2). 

So far we have assumed that functions f{ip) may vary freely in the class of functions specified by condition 
It is possible, however, to show that the transient performance of system ^ with algorithms ^ can 
further be improved when fmictions (p{4') sue linear in ip. An additional assumption on the growth rate of 
function /(x, 9) in 9 will make the whole system exponentially stable. This new assumption is formulated 
as follows: 

Assumption 4 For the given function f{x.,9) in ^ and function a(x, i), satisfying Assumption\^ there 
exists a positive constant Di > such that 

|/(x, 9, t) - /(x, 9,t)\> I?i|a(x, tf{9 - 9)\ 

Assumption ^ extends Assumption |21 by stipulating a lower bound for the growth rate of nonlinear function 
/(x, 9) in 9. This assumption allows us to show that exponential convergence of to will automatically 
result in exponentially fast convergence of function t) to the origin. Furthermore, it ensures exponential 
convergence oi 9 to 9 for any positive-definite constant F. These results are formulated in the following 
theorem: 

Theorem 2 (Exponential Convergence) Let Assumptions\^^hold and (p{ijj) = Kijj, K > {). Then 

P6) function 'il){'x.{t),t) converges exponentially fast into the domain |?/;(x(t), t)| < 0.5y^||^(0) — ^||(xDr)-i ' 

Specifically, the following holds: |V'(x(i),i)| < |V'(x(0), 0)16--^'* + Q.b^\\9{Q) - 6»||2^^p)_i 

Furthermore, let As sumption^ hold, function a{x,t) be locally bounded with respect to x and uniformly 

bounded in t; for any bounded x there exist Di > such that \f{:x.,9,t) — f{x,9,t)\ > Di\ot{x,t)'^ [9 ~ 9)\, 

function Q;(x,i) is persistently exciting: 

pt+L 

3L > 0, (5 > : j a(x(T), T)a.{x{T),Ty dr > 51 yt > 0, (9) 

where I G Jid.xd _ jfigj^fjiy matrix. Then 

P7) both ■i/;(x(t),i) and \\9 — 9\\ converge exponentially fast to the origin. 

It is desirable to notice that one can derive more precise conditions for exponential convergence of the 
estimates with algorithms {TJ from the proofs of Theorems ^ 13 In particular in the proofs we neglected 
term /?(x, i)JF(x, 9, 9) in the equations for derivatives 9. The complete set of conditions would be, therefore, 
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as follows: 

3£>0, ,5>0: (^o^(x(t),0,0(T),r)^o(xW,0,^(r),r)+ (10) 

/3(x, <) J^(x, e, e{T)))dT >SIWt> 0, 

where matrix function ^(x, 6, 0{t)) is defined as in Assumption |31 and function J-o{x., 6, 6, t) is: 

^o(x, 6», e, t) = /' MZllli^dA, s(A) = e\ + 0(1 - A) 
Jo 

So far we have shown that, for the class of nonlinearly parameterized systems, there exist a control 
function and parameter adjustment algorithms such that solutions of the whole system are bounded, and 
parametric uncertainty is decreasing in time. We have shown also that in case of persistently excited functions 
a{x,t) the estimates 9{t) in (0) converge exponentially fast to vector 0. These results will now be extended 
to a broader class of nonlinearities. We replace Assumptions |2 0] with their locally verified versions. 

Assumption 5 For the given nonlinear function /(x, 9) there exits the following partition of the state space: 

Ox = iiM(x) u r^A, riA/(x) = |JriA/j(x), r^A = r2x/f^A/(x) 

where ilM.ji^) — {x|(x — Cj)'^{x — Cj) < r|} are the balls in R" where Assumptions\^ ^ are satisfied for 
every 9 ^ fig and corresponding functions Q;j(x, i) and constants Dj, Dij. 

A typical example of a nonlinear function which satisfies this assumption is sin(0x), where the unknown 
parameter 6 belongs to a bounded interval. Another example is a;^, 9 G [0, oo). The last parametrization 
is widely used in modelling physical "power low" phenomena in nature (see, for example |3(J|. where this 
function models effects of nonlinear damping in muscles). 

In the sequel we will denote control functions Q associated with parameter adjustment algorithms in 
^M,j by symbol uoj{'x.,t). Once Assumptions [3 01 hold only locally, we can guarantee convergence of the 
estimates only if the state belongs to fiA/ (x). Therefore, extra control effort is needed. In order to specify the 
desired feedback acting in the domain Qa we introduce the following assumption on system ^ dynamics: 

Assumption 6 For any xo G Ox there exists a control function Uj (x, t) that steers the state x of system 
0J) into the neighborhood of Cj : jjx — — ^ ''I ''^ finite time. 

It should be noticed, however, that this assumption does not require existence of stabilizing feedback, local 
or global in Lyapunov sense, at the points x = Cj . 
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Let us finally consider the following control/identification scheme: 

r x = B,,,^. ^/n^ fO, ||x(0)-c,|| 

I <y,. x^B,,.^. ' ^^-^^^ \ 1, ||x(0)-c,||<^, 

Bjfl = {x : |[x- Cjll = 5j}, Bj,i = {x : ||x - Cj\\ = r^} 
It = (1 — aj)uj{:x., t) + f7jMo,i(x, t) 

e - c7,r(0p(x,t) + 0/(i) + Q(t)); 

0p(x,t) = ?A(x,t)aj(x,t) - ^'j(x,t) 

Oi = aj{ip{'ilj{-K,t))aj{:>c,t) +d'i'j(y:,t)/dt-ip{yi,t){da.j{TC,t)/dt) - 

(V'(x,<)Lf,aj(x,<) -if,*j(x,i)) - (V'(x,<)Lg,aj(x,i) - Lg,^'j(x,<))M(x,0,i) 

(x, i)(f2(x, 0) + g2(x)7.(x, 9, t))) (11) 

C,(t)-(0p(x(t^_l),i',_l)-0p(x(t,),t,;)+C,(t:_l)), 

where ti are the time instants when x hits the domain ||x — Cj|| = Sj for aj — 1 and > stands for the 
time moments when the state x reaches ||x — Cj|| = rj (for aj = 1). Algorithm 111() includes algorithm |(7|) as 
a part. It also includes switching algorithm which specifies the time when parameter estimation procedure 
shall be turned "on" / "ofF . The identifying properties of this new algorithm follow from Theorems ^ El 
and are formulated in the following corollary: 

Corollary 1 Let Assumptions^ \^ hold and there exist at least one Q:j(x, t) such that Assumption\^ is 
satisfied. Then system 0), trajectories are bounded. If, in addition, function Q:j(x, t) is persistently 

exciting: 

ft+L 

38 >Q: j OL{-x.(T),T)oL{y.{T), rfdr > 61 Wt > 0, (12) 

with sufficiently small L > 0, then parameters 6{t) converge to 6 t oo monotonically with respect to the 
norm ||^(i) - e\\. 

A consequence of Corollarynis that increase of excitation in functions aj(x, t) results in an extension of 
the class of nonlinearities suitable for our approach. This is consistent with previously reported results 7 on 
parameter convergence in nonlinearly parameterized systems. Whether extension of the class of nonlinearities 
to more general functions renders it necessary to increase excitation, however, is still an open issue^. 

For illustration consider the following system as an application of Corollary 

±2 — sin(6'a;i) + M, (13) 

^An example is constructed in [J, where nonlinear persistent excitation condition holds for the given parametrization, while 
the linear persistent excitation condition for linear parametrization with respect to the same parameter-independent function 
is not satisfied. 
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where parameter 9 £ Vie = [0.6, 1.4] is unknown a-priori. The goal is to design input X2, t) and estimator 
6{t) such that trajectories of the system are bounded and d{t) 6* as t — > oo. For the given bounds of fig 
we first find the domain Hm, satisfying Assumption 

nA/(x) = {x I a;i e [-3.38, -2.59]} U{x | xi G [-1.14, -1.14]} U {x | xi £ [2.59,3.38]} = nM.i^^M,2^^M,3 

Let us suppose that initial conditions of system 113|) are located most closely to the subset JIm.iCx) = 
{x I xi e [—3.38, —2.59]}. Then it is natural to assume that the desired position of the plant for the purpose 
of identification is in the center of flM.i ■ x\ = x\ ~ —2.985. Function ^plx-^t) satisfying Assumption ^ is 
chosen in the following manner: iIj{xi, X2) = xi + X2 — xl- Hence, according to I^J, control inputs uo,i(x, t), 
Mi(x, t) are given by equations: 

uo,i(x) = -X2 - sin(6', a;i) - ip{xi,X2), ui(x) = -X2 - 'ip{xi,X2) - sign(V'(a;i, a;2)) 

Function a{xi,X2) — — a^i, and function 0p, in (|11|) is as follows: 

2-2 

6'p(x) = '\\){xi,X2)ol{xy,X2) - *(xi,a;2), *(xi,X2) = (xi - x\)x2 + Y' 

Function Bi now follows explicitly from equation (|11|) . 

In the next section we illustrate the application to and main steps in the design of our algorithms for 
two diverse, challenging and practically relevant problems. In the first example we apply our approach to 
the optimal slip identification problem in brake control systems. The second example provides a system for 
adaptive content-dependent filtering and classification of visual information. 

4 Examples 

Example 1. Braking wheel control problem. Consider the problem of minimizing the braking distance for a 
single wheel rolling along a surface. The surface properties can vary depending on the current position of 
the wheel. The wheel dynamics can be given by the following system of differential equations |24j : 

ii = --i^,(F„,x,0) 

TO 

±2 = j(i^s(i^„,x, 6')r - w) 

X, = --((-(l-:r3) + 4)^«(^.^)->)' (14) 
xi m J J 

xi is longitudinal velocity, X2 is angular velocity, x^ = (xi — X2)lxi is wheel slip, to is mass of the wheel, 

J is moment of inertia, r is radius of the wheel, u is control input (brake torque), Fs{Fm x, 6) is a function 

specifying the tire-road friction force depending on the surface-dependent parameter 6 and the load force 

Fn- This function, for example, can be derived from steady-state behavior of the LuGre tire-road friction 

model 0: 



Fs(F„, X, 9) = F„sign(a;2 



^g{x2,x^,e)j^ 



3:3 
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where Ms £^re Coulomb and static friction coefficients, Vs is the Stribeck velocity, do is the normalized 
rubber longitudinal stiffness, L is the length of the road contact patch. In order to avoid singularities we 
assume, as suggested in [23], that the system is turned off when velocity xi reaches a small neighborhood of 
zero (in our example we stopped simulations as soon as xi becomes less than 5 m/sec). 

While the majority of the model parameters can be estimated a-priori, the tire-road parameter 9 is 
dependent on the properties of the road surface. Therefore, on-line identification of the parameter 9 is 
desirable in order to compute the optimal slip value 

^3 = argmaxF5.(F„,x, 6*) (15) 

which ensures the maximum deceleration force and therefore results in the shortest braking distance. 

The main loop controller is derived in accordance with the standard certainty-equivalence principle and 
can be written as follows: 

J 1 

w(x, 9, x^) = -((-(1 - x^) + -j)Fs{F,„^, 9) - KsXiix3 - x^)), > 

In order to estimate parameter 9 by measuring the values of variables xi^X2 and X3, we construct the 
following subsystem: 

£3 = - — ((— (1 - X3) + '-)FsiFn,X, 9) - -U) + {X3 - X3) 

Xi m J J 

and consider dynamics of the error function ip{'x, t) — ip^x^, X3) — X3 — £3: 

^ = + —((-(1 - X3) + ^)(F,(F„,x,0) - F,(F„,x,^)) (16) 
Xi m J 

Function 7j-((^(l — 2:3) -|- ^)i^s(x, 6*) is monotonic in 9 and satisfies Assumptions El El with 

1 1 r2 
a{x,t) = —(( — (1 -X3) + —)g{x2,X3,l) 
xi m J 

Therefore, in order to design an estimation scheme satisfying assumptions of Theorem (51 we shall find 
functions ^'(x, i), /3(x, i) such that Assumption (21 holds. Notice that every equation in H14|l depends on 
unknown parameter 9 explicitly. Therefore, according to the introduced terminology, there is no uncertainty 
independent partition of system H14() . i.e. x = X2. Let us choose /3(x, t) = 0. Then Assumption reduces to 
the following equation: 

g^(x,t) ^.9a(x) 

— ^ = '/'X, t)— — 17 

ox ox 

Instead of trying to solve this equation explicitly for function ^'(x, t) we em&ed system (|14f) . (|16f) . as suggested 
in |5B1, into one of higher order, such that for the new set of equations Assumption O will be reduced to a 
case where q;(x, t) does not depend explicitly on X2. In fact, the problem with AssumptionOwould be solved 
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if we replace a(x, t) with the function of time ^(i) : R+ R, of which the derivative is known. Let us 
derive the required function ^(t). Notice that function a(x, t) is continuous in its arguments and, moreover, 
differentiable for xi > 5. Therefore, given that the right-hand side of system p4|l is locally bounded, we can 
conclude that function a(x, t) has a bounded derivative for bounded x. The state, moreover, is bounded as 
longitudinal velocity xi and angular velocity X2 are bounded during the braking/acceleration regime, and 
relative slip 2:3 is bounded by the way it is defined in (|14() . Therefore, it is possible to track signal a{x{t),t) 
with arbitrary high precision by use of smooth high-gain estimators. If estimators with discontinuous right- 
hand sides are allowed then it is possible to provide exact tracking of a{x,t). Let us consider the following 
candidate for the estimator of a{'x.,t): 

■ da 1 da I r , , ^ . , ^ 

where > and ip^{(, — a(x, — a{x, t)) > are to be chosen to dominate the following sum 

/ da 1 da r da 11 \ 

+ ^7 - ^-((-(1 - 2^3) + -j) F.(F„,x,0) 
\ dxi m dx2 J dxs xi m J J 

for xi e [5,40], X2 G [100,1], 2:3 e (0,1), 6 e (0,2] and |^ - a(x, i)| > £0 = 0.001. Let us assume for the 
moment that function a(x, t) = S,{t). Taking this property into account we can extend system l|16|) with 
equation H18|) and replace function a(x, t) in description Q of the algorithm with function ^(t) of which 
the derivative is known. Hence, for the new system Assumption |21 will be automatically satisfied. Then 
according to iQ and (|1B|I parameter adjustment algorithm will be given by the following system: 

e"=-7((2:3-i3K + ^/), 7-100 (19) 

^/ = (x3-i3)(e-?) 

The only difference between algorithm 1191) and those which follow from explicit analytical solution of (|17|l 
is in the residual term e{t) = ^ — ct(x, i), which can be made arbitrary small. On the other hand, according 
to Theorem|21the original system (without replacing a(x, f) with ^(t)) is exponentially stable, which in turn 
guarantees convergence of the estimates 9 to the actual values of 9 with algorithm ({T^ if e{t) is sufficiently 
small^. 

We simulated system (|14|l - (|19|) with the following setup of parameters and initial conditions: (Tq — 200, 
L = 0.25, ^ic ^ 0.5, ^is = 0.9, Vs = 12.5, r = 0.3, m = 200, J ^ 0.23, F„ = 3000, K, = 30. The effectiveness 
of estimation algorithm (|19|l could be illustrated with Figure 1 . Estimates 9 approach the actual values of 
parameter 9 sufficiently fast for the controller to calculate the optimal slip value and steer the system 
toward this point in real braking time. Effectiveness of the proposed identification-based control can be 
confirmed by comparing the braking distance in the system with on-line estimation of according to 

^In this particular example in addition to the exponential stability argument one can easily derive from differential equations 
for 6: 6 = —7(1/' -I- V')(«(x;, t) + e{t)) from the proofs of Theorems [Tl 1^ that. This equation implies exponential convergence of 
6 to 0, provided that a(x,t) — e{t) > 5 > for some positive constant 5 
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Figure 1: Plots of the trajectories of system (|14(l 

formula H15|) with = with the one, in which the values of x'^ were kept constant (in the interval [0.1, 0.2]). 
For model parameters as presently given and road condition given by the piece-wise constant function 
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the simulated braking distance obtained with our on-line estimation procedure of X3 is 54.95 meters. This 
result compares favorably with the values obtained for preset values of Xg, which range between 57.52 and 
55.32 (for = 0.1 and = 0.2 respectively). 

Example 2. Classification of occluded and linearly nonseparahle patterns. Another illustrative application 
of our parameter identification scheme is taken from the field of neural computation and control of biological 
systems. In these domains functions that are nonlinear in their parameters are widely used. We will discuss 
an example involving a model of visual object recognition system with adaptive identification of local spatial 
features of the presented objects. 

The problem is to identify two visual patterns given that they may be out of focus (blurred), partially 
occluded by each other, slightly distorted, or incomplete. A typical classification system for this purpose 
consists of a two-layer neural network in which the first, sensory layer feeds its outputs to a layer of decision 
units. 

We modeled a simple pattern recognition system, consisting of a pattern input system and two image 
template systems. In the input system, visual information arrives initially in a two-dimensional array {i,j) 
of sensors. The output of each sensor is mapped onto the first layer, which consists of a two-dimensional 
array (i,j) of filters. The connectivity of the sensors to the filters is onc-to-all, but assures topographical 
projection by means of connection weights. Maximum weight is given to topographically corresponding units. 
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neighboring ones receive exponentially declining weights. The process is functionally equivalent to spatial 
integration with an exponential kernel. The output of these filters is projected topographically (one-to-one) 
onto the second layer, which consists of a two-dimensional array of decision units. Connections within each 
layer have not been modeled at any of these levels. The architecture of the template systems is identical 
to that of the input system, except that each of the sensors is replaced by a binary value ("off" or "on"), 
corresponding to the template of an image stored in memory. These images can be represented by binary 
matrices Pi and P2 correspondingly. 

The input and template systems are connected at the level of the first and second layer. Connections 
at the level of the filters layer are one-to-one, reciprocal but not symmetrical, between the filters and their 
counterparts within each of the template systems. Connections at the level of the decision layer are all-to-all, 
reciprocal and symmetrical (for simplicity) between the decision units and their counterparts in the template 
systems. Also the two template systems are connected to each other in this manner at this level. 

Whereas the sensory units locally filter the spatial information in the input, the decision nodes match 
it with the templates. The information in the input system matches either of the templates, to the degree 
that its units are synchronized with those of either template. In addition, the location of the synchronized 
nodes in the decision units indicates where the matching occurs in the input. 

The decision units and their counterparts in the template systems can be modelled by the following 
ensemble of Hindmarsh and Rose spiking neurons |14|^: 

ii,fc = -axi l, + bxl^k + Xi,k + X2,k - x^,k +Uk + h 

X2,k = C - dxl f, - X2.k 

Uk = l{xi.ra + xi,r - 2xi^k), m ^ r, k ^ m, /c, m, r G {1, 2, 3} (20) 

Parameters a, 5, c, d, s, xq, e, /q are all positive constants with the following values: a = 1, b = 3, c = I, d = 5, 
s = 4, xq = 1.6, e — 0.001, Iq = 1.4 as specified by 0. Function — —2xi^k + a^i,fc + Si,fc is the coupling 
function, variables £i,fc, xi.fc are the outputs of the template systems at the level of the decision units and 
their corresponding coupling functions are Uk = —2xi^k + xi^k + xi^k, Ufc — ~2xi_fc -I- xi^k + xi^k- 
Variable ^4^^ stands for input dependent current produced by the sensory cell: 

i4,fe = -(/3-X4,fc-Kr(0o,Sfc(t))) (21) 

T 

N N 

, , , , i(fc)-i| + |j(fc)"j 

r(6lo,Sfe(i)) = Z^Z^e ^5 Sfe,,j(5(i - r,j), /? > 

i=l 3 = 1 

i{k),j{k) specify the position of the fc-th unit, r > is the integration parameter, Sk,ij denotes intensity 
of the (i, j)-th element in the image, 6{t — tij) : M ]R>o stand for the pattern-induced signals (impulses 

®For the sake of compactness in the text hereafter we omit indices i,j in the subscripts of the system variables 
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of unit amplitude and width A = 0.05T at t = Ti_j, where T is the period of generation of each impulse). 
Exponential functions in r(0Q,Sk(t)) represent the distribution of the weights. Numbers Tij stand for time- 
delays in the transmission of the signal from a sensor to the filters. This delay is variable due to the 
difference in properties of the transmission cables. It is given by the ration of cable length and width, 
which is a simplification of actual signal transmission on neural systems. These delays together with the 
exponentially decaying amplitudes of Sk.ij in space form the receptive field of a filter. One of the main 
properties of such an organization is that input signal Sk{t) is distributed in time and space, providing in 
principle a unique spatiotemporal signature for every different static visual pattern. 

For the template systems the pattern-induced currents evolve according to the following equations 

T 

X4,k = -{-f3x4,k + r{0o,Sk(t,0i))) (3>0 

T 

where functions s^; (t) and s^^ (t) are the outputs of the spacial filters with parameter 9i : 

^ ^ |- I I -I ^ ^ |- I I ■ 

Sk,i,j{t) = S{t - nj) ^ Pl,ni,r, Sk,i,j{t) = d{t - Ti^j) ^ ^6 P2.,m,r 

m—1 r—1 m—1 r—1 

This filters model effects of changes in intensity of the light, focal adaptation and sharpness of the templates 
in presented visual patterns. 

The problem for such architecture is the following: if the picture is not stable in time and perturbed by 
unmeasured changes in focus, then how can the decision units reach detectable synchrony? 

Technically, the solution would be to adjust parameters Oi in 122(1 in response to distortion in the input 
patters. The difficulty, however, is that the functions r{0,Sk{t,0i)) r{9,Sk{t,9i)) are nonlinear in parameter 
01. Classical linear identification schemes result in a prohibitively large dimension of the estimator (in 
our simplified example a 100 x 100 sensory field will require 10^° independent parameters in each cell). A 
further problem is that of performance in terms of robust identification of the parameter for slightly distorted 
patterns, if no persistent excitation in Sk{t) is assumed. For these reasons we would require new adjustment 
algorithms to estimate parameters 0i, Oi in the junctions of nodes H20|l . (|21|l in order to ensure adaptive 
properties of the classifier together with practical realizability and reliability. 

In order to derive the estimation algorithms for the parameters 9i in the templates we introduce the 
following error functions: ij}^ = X4,k — X4^k, i^k = X4^k — X4^k- Dynamics of function V'fc(^)i for example, 
follows from and if^ : 

4 = --^ + ir{0o, Skit)) - r{0o, Skit, 0i))) (22) 
r 

If the image contains the distorted template locally then the following equality holds: Sfc(i) = Sfc(i,6'i), and 
equation H22() becomes as follows: 

^ = -l^iP + (r(0o, §fc(t, ^i)) - r(0o, Sfe(t, ^i))) (23) 

T 
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Figure 2: Reference patterns of the template system (A,B); distorted, combined pattern (C) ; blurred versions 
of the distorted pattern (D,E) 

Function Sk{t,9i) is monotonic in 6i with respect to di (i.e. with constant a(x, i)). Hence, Assumptions |2 
0]are at least locally satisfied. Moreover, function a(-) does not depend on x, so Assumption 01 is satisfied as 
well. Therefore, applying Theorem |21 we can derive parameter adjustment algorithm in the following form 

di,i = - {xi.k - Xi,k) (24) 
r 

According to Theorem |21 algorithm 124|) combined with (|22ll result in the desired estimator of 9i, which in 
addition guarantees exponential stability of the whole system with respect to the small perturbations in the 
presented patterns. 

To illustrate the performance of our classifier, a square and a cross (Figures 2 A and B) were used as 
reference patterns in the template system. They were distorted and combined, one partially occluding the 
other as in Figure 2 C. Blurred versions of Figure 2 C, shown in 2 D and E, were presented to the system. 
The task was to recognize the patterns at their corresponding locations. In our simulations we used the 
following values of the model parameters: (3 = 0.02, t = 0.01, r^.j were set chosen in the interval from to 
100, 7 = 1, xi^fe(O) = -1.6, X2,m = -11.83, a;3,fc(0) = 1.46, /„ = 1.4, a;4,fc(0) = 0, 0"/(O) = 1. 

Figure 3 shows the responses of two of the decision nodes. Those decision nodes that are topographical 
projections from regions where the square appeared are synchronized with their counterparts in the "square" 
template system. Likewise, those which correspond to regions where the cross appeared were synchronzied 
with their counterparts in the "cross" template system. The synchrony occurs because the for the counter- 
parts the parameters 9i { ov 9i) converge to their true values. Evolution of the estimates of 9i is shown in 
Figure 4. 

Decision nodes at regions where no pattern was presented and their counterparts in the template systems 
fail to reach synchrony. The **theta parameters of these units, however, remain in a bounded domain. 

5 Conclusion 

We proposed a new class of parameterizations for nonlinearly parameterized models. Instead of aiming at 
a general solution for the problem of nonlinearity in the parameters, parametrization was restricted to a 
set of smooth functions, which are monotonic with respect to a linear functional in the parameters. For 
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Figure 3: Response of the decision nodes located in points (90,90) (plots a-c) and (5,20) (plots d-e) respec- 
tively. Plots a, d contain trajectories xi^k{t) of the decision cells corresponding to the actual image, plots b, e 
reflect differences in the responses between the actual scene and memorized pattern "rectangle", plots c, / 
show deviations in perception of the scene and pattern " cross" 




Figure 4: Trajectories of Oi{t) in the decision cell located at the point (90,90) (plot a), and Oi{t) in the 
decision cell located at the point (5, 20) (plot b). 
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this new class, estimation algorithms were introduced and analyzed. It was been shown that standard linear 
persistent excitation conditions suffice to ensure exponentially fast convergence of the estimates to the actual 
values of unknown parameters. If, however, the monotonicity assumption holds only locally in the system 
state space, excitation with sufficiently high-frequency of oscillations is needed to ensure convergence. It is 
also desirable to notice that in case of linear parametrization the proposed parameter estimation schemes 
allow to estimate the unknowns in a dynamical system without asking for usual filtered transformations, 
thus reducing the number of integrators in the estimator. 

Two rather distinct applications of our method were provided as examples. One is devoted to on-line 
identification of the optimal slip in a braking wheel. The second example touches on the problem of dynamic 
recognition of visual patterns in artificial neural networks. Both problems may be considered to have practical 
significance. The effectiveness of the solution to these problems leads us to expect that this method can 
successfully be implemented in other applications. 

6 Appendix 

Proof of Theorem^ Let us ffi-st calculate time-derivative of function 6{x,t): 6{x,t) = r{9p + Oj) = 
r('0a(x, t) + ijja{x, t) - 4>{x, t) + 9i). Notice that 

?Aa(x, t) - *(x, t)+ei^ t) ^^'^ ^ xi + ^(x, + V'(x, t) g^' ' - 

a£(x^. 9^(x,t) , ^ 

According to Assumption^ = "(/"(x, t) ^"'q^^*'^ + /3(x, t). Then taking into account H25|l . we can obtain 

/3(x,t)(f2(x,0)+g2(xH + ^/ (26) 

Notice that according to the proposed notation wc can rewrite the term ^■0(x, t) ^"^J*'' — in the 

following form: (V'(x, i)LfjQ:(x, t) — if^ 'I'(x, t))~\^ (V'(x, <)£giQ:(x, t) — igj5'(x, t)) u{x, 9,t). Hence it follows 
from and (jSEl that 7/>a(x, i)-*(x, = (/j(-(/')a(x, t) -/3(x, i)(f2 (x, 0) -f2(x, 0)). Therefore derivative 

0(x, t) can be written in the following way: 

b = r((V3 + ^W)a(x, t) - f3{x, i)(f2(x, e) - f2(x, 6))) (27) 

Consider the following positive-definite function: Vq{9,6) = — ^llp-i- ^^s time-derivative according to 
equations (|27|l can be obtained as follows: 

v^{e, 6) - (^(^) + ^){e - efa{x, t)-{e- efp{x, t)(f2(x, e) - f2(x, e)) 

Let (3{x,t) ^ 0, then consider the following difference f2(x, 0) — f2(x, 0). Applying Hadamard's lemma we 
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represent this difference in the following way: 

f2(x,0)-f2(x,0)= ^MZ^£iMdA(0 - 0), s(A) = 0A + 0(1-A) 
Jo OS 

Therefore, according to Assumption O function {9 — 9)'^ f3{x, t){i2{x, 9) — f2(x, 0)) is positive semi-definite, 
hence using Assumption |21 and equality Q we can estimate derivative as follows 

V^{9, 9) = -(/(x, 9, t) - /(x, 9, t)){9 - 9fa{^, t) < -D{f{^, 9, t) - /(x, 0, t)f = -Z?(^(^) + tA)^ < (28) 

Therefore Vg is non- increasing (property P2) is proven). Furthermore, integration of Vg with respect to time 
results in 

Vg{m,9) - Vg{9{t), 9)>D f {i,{T) + ^{^{T))fdT > 0. 

Jo 

Function Vg is non- increasing and bounded from below as Vg > 0, therefore 

D f{^{T) + ^(V'(T)))2dr < Vgim, 9) < oo. 
Jo 

Hence (ipO^) + V-) = (/(x, 0, t) - /(x, 9, t)) = (/(x, 9, t) ~ /(x, 0, i)) e (property P3)). 

To prove property PI) let us consider the following function; V{ip,9,9) — 2DQ{iJj) + Vg{9,9), where 
Q{ip) — ip{<;)d<;. Function Vlijj, 9) is positive-definite with respect to '(/'(x, t) and 9 — 9. Its time-derivative 
obeys inequality: V{i(;, 9, 9) < 2DLp{ip)ijj - D{ip + ^p{ip)f = -D(p'^{ip) - Dip'^ < 0. 

Therefore, function V{ip, 9, 9) is bounded and non-increasing. Furthermore 

oo > F(V'(x(O),O),0(O),6>) > F(V'(x(O),O),0(O),0) - V(V'(x(t),t),0(t),6>) > of (^2(^(x(r), T))dT > 

Jo 

cx) > y(V'(x(O),O),0(O),0) > y(V'(x(O),O),0(O),0) -F(V'(x(t),t),0(t),6») > d[ iP^iT)dT>0. (29) 

Jo 

or, equivalently, ip{t) £ L2, (p{ip{t)) G £2- Hence, property PI) is proven as well. The L2 norm bounds ((SJl 
for (p{ip) s-nd ip follow immediately from inequality H29|) : 

||<^(^)||^ < i?-V(V'(x(O),O),^(O),0), llV-li^ <i?~V(^(x(O),O),0(O),0) 

The Loo norm bound for V'(x(t), i) rcsuhs from the inequality: V"(V'(x(0), 0), 0(0), 0) -y(V'(x(t), t),9{t),9) > 
0. Consider function A defined as A{d) = max^^^{\ip\ \ jj^^^ Lp{c^)d(^ = d} and notice that it is monotonic and 
nondecreasing. Therefore, given that J^'^^'^*^'*'' tp{';)d(, < jjjV{ip{x{0), 0), 9{0), 9) we can conclude that \^\ < 
A (^2^F(V'(x(O),O),0(O),0)). To prove property P4) notice that function V{ip{-K{t),t),9{t),9) is bounded. 
Hence, as follows from condition jSJl, function V'(x(i),i) is bounded as well. According to Assumption ^ 
boundedness of V-'(x(t),t) implies boundedness of the state x. In addition it is assumed that f{x.,9,t) is 
locally bounded with respect to x, 9 and uniformly bounded in t. Therefore the difference /(x, 9, t) — f{x, 9, t) 
is bounded. Furthermore, according to (O, function (p{il>) G C*^ and therefore, given that ip is bounded, this 
function is bounded as well. Hence ip is bounded and by applying Barbalat's lemma one can show that 
■>p(x{t),t) ^0 att ^ 00. 
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To compete the proof of the theorem (property P5) consider the difference f{x,6,t) — f{x,0,t). Let 
function <y9 G C^, function f{:x.,9,t) is differentiable in x, 9; derivative df{x,6,t)/dt is bounded uniformly 
in t; function q:(x, i) is locaUy bounded with respect to x and uniformly bounded with respect to t, then 
d/dt{f{K, 9, t) — /(x, 9, t)) is bounded. On the other hand there exists the following limit 

lim / (/(x, 0, r) - /(x, 9, T)f = / (/(x, 9, r) - /(x, 9, T)f < -¥^{9(0), 9) 



as /p(/(x, 0,r) — f{x,9,T))^ is non-decreasing and bounded from above. Hence by Barbalat's lemma it 
follows that /(x, 9, t) — /(x, 0, r) ^ as i ^ oo. Notice also that V'(x(<), i) ^ as t ^ oo. Then — > as 
i — > cxD. The theorem is proven. 

Proof of Theorem\^ Consider the following integral^ /q (V'(t) + lp(%1:{t))'^ dT . It was shown in Theorem 
□ proof that /^(V'Ct) + Lp{ip{T)fdT < 2^||^(0) - 0||p_i along system O, gj), ij^TJl solutions. Let us define 
li{t) = m + ^im), or 

^ = -ipW + ^i{t), (30) 

where ^'^{T)dT < iyj^\\9{0) — 0|lp-i. According to the theorem conditions, f{tp) = Kip, it is possible to 
derive the solution of equation H30|l as follows ip{t) = ?/'(0)e~^* + /J e"^^*'^'^^ iJL{T)dT . Hence 



< \^iO)\e-^^ + y^\\9{0)-9\\l_,. (31) 
Property P6) is thus proven. In order to prove property P7) consider 

b^T{i: + ^(V))a(x, t) = r(/(x, 9, t) - /(x, 0, <))a(x, i). 

Function 

Di\a{x,tf{9-9)\ < \f{x,9,t) - f{x,9,t))\ < D\a{x,tf{9 - 9)\ 
a(x, tf{9 - 0)(/(x, 0, i) - fix, 9, t)) > V /(x, 9, t) ^ /(x, 0, t). 

Therefore, there exists Di < K{t) < D such that 

9 = -K{t)ra.{x, t)^{9 - 9)cx{x, t) = -K{t)Ta{x, t)a{x, t)'^{9 - 9). 

Hence 

9{t) 9 = e-^^« '^(r)a(x(r),r)«(x(r),r)^dT(^(Q^ _ g,^ (32) 

Consider the integral F K{T)c)L{x(T),T)a.{x{T),T)'^ dr for t> L 

rf K{T)a.{x{T),T)a{x{T),Tf^dT>TDi I a{x{T),T)cx{x{T),T)^dT, 

''We substitute the arguments of the functions ipi') and tp(-) with t. This means that we consider them as functions of time. 
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where a.{x{t),t) is persistently exciting. For any t > L there exists integer n > such that t = nL + r, 
r e R,0 < r < L. Therefore 

TDi J a{x{T),T)a{x{T),TfdT > TDinSI > f — - ■ 

Then taking into account (|32|l one can write 

\m-0\\<\\e(''-^'+'h\\\m-ei (33) 

i. e. 9{t) converges to 9 exponentially fast. It means that there exist positive constants X > 0, X ^ K and 
> such that \\e{t) - e\\ < e"^*||0(O) - e\\Dg. It follows from Theorem [l] that V(x(t),i) is bounded. 
In addition due to Assumption ^ we can conclude that x is bounded as well. By the theorem assumptions 
function q;(x, t) is locally bounded with respect to x and uniformly bounded in t. Therefore, there exists 
Da>0 such that |q;(x, t)^(0(i) - 0)| < Da\\9{t) - e\\. Taking into account that /(x, 0, t) - /(x, 0, t) = ^{t) 
and |/(x, 9, t) — /(x, 9,t)\ < D\cy.{x, t)'^{9{t) ~ 9)\ we can derive from (|30|l the following estimate 

\m\ < IV^Ojle-^* + \\m - 9\\D^D^dJ^ e-^(*-^)e-^-dT < |^(0)|e-^* + ^^^^\\9{0) - 9\\e-'' (34) 

The theorem is proven. 

Corollary proof. In order to prove the corollary, we notice first that function aj is equal to unit for 
the following segments of the system solutions: ||x(xo, io, t) — Cj \\ < r^, ||xo — Cj \\ < Sj. Let us consider two 
cases: 1) ||x(xo,ioi^) ^ < rj for any t > Iq, and 2) for any Iq and ||x(xo, toi ^o) ^ < rj there exist 
<i > to such that ||x(xo, t^, t) — Cj \\ = rj. 

In the first case Theorem |5] explicitly applies and the corollary follows automatically. In the second case, 
we can derive from Theorem |21 that ip{x,t) is bounded for every t £ [to,ii]- Furthermore, according to the 
properties of function '0(x, i), it is bounded in t for every x : ||x — Cj\\ < Sj. Let us denote this bound by 
symbol A^. Therefore, according to TheoremQlwe can derive the following estimate of |V'|oo for t G [^o, ^i] 

|V^(x,t)| < A (q(Av,) + \\9{t,) - 0||^4OT)-i) 

Given that norm ||0(to) — ^ll(4Dr)-i ^'^^ increasing, we can bound function ?/;(x, <) for any time moments 
t : <Jj{t) = 1 as follows: 

|V'(x,i)l < A (g(A^) + \\m - 0||^4^p)-.) 

On the other hand, due to the smoothness of function ip{'K.,t) and Assumption one can show that ^/'(x, i) 
is bounded for every t : (Jj{t) = 0. Hence, as follows from Assumption state x of the system is bounded. 
In order to complete the proof we must show that 9{t) 9 as t ^ oo. We have just shown that state x(t) 
is bounded. Then it is bounded for those time intervals when <Tj = 1 (i.e., when the estimator is turned on). 
This implies that for any k = 1,2, oo the difference t'/^ — tk > 6t > (i. e., the time when the estimator is 
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turned on is bounded from below). Therefore, assuming that L is sufficiently small (for instance, L < St/2) 
and applying the same arguments as in the proof of Theorem |21 we can show that 

||^(4)-e||<l|e(-^<"-^))||||^(<.)-0||, 
where t'f, —tk + nL + < r < L. The corollary is proven. 
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